AI-based novelty detection in crowdsourced idea spaces
نویسندگان
چکیده
Processing large and heterogeneous numbers of ideas submitted to crowdsourcing contests is a regular challenge for idea evaluators. The aim this study investigate potential use case AI-based innovation management extend the knowledge using automated novelty detection in evaluation processes. language models can automatically allocate short texts according their semantic similarity an embedded space. We represent content crowdsourced with three contemporary text embeddings – Doc2Vec, SBERT, GPT-3-based Ada Similarity compute distance different reference sets algorithms. then compare algorithm-generated scores human assessments validate them. While selected based on correlate humans, our results show that SBERT best match assessments. also find approaches perform better below median word count when compared set existing solutions, suggesting chosen model not only factor influencing applicability proposed approach. Furthermore, highlights important features limitations generated need be considered complementing evaluators searching new beyond.
منابع مشابه
Novelty Detection in Projected Spaces for Structural Health Monitoring
The aim of Structural Health Monitoring (SHM) is to detect and identify damages in man-made structures such as bridges by monitoring features derived from vibration data. A usual approach is to deal with vibration measurements, obtained by acceleration sensors during the service life of the structure. In this case, only normal data from healthy operation are available, so damage detection becom...
متن کاملModelling efficient novelty-based search result diversification in metric spaces
a r t i c l e i n f o a b s t r a c t Novelty-based diversification provides a way to tackle ambiguous queries by re-ranking a set of retrieved documents. Current approaches are typically greedy, requiring O (n 2) document–document comparisons in order to diversify a ranking of n documents. In this article, we introduce a new approach for novelty-based search result diversification to reduce th...
متن کاملGraph-Based Text Representation For Novelty Detection
We discuss several feature sets for novelty detection at the sentence level, using the data and procedure established in task 2 of the TREC 2004 novelty track. In particular, we investigate feature sets derived from graph representations of sentences and sets of sentences. We show that a highly connected graph produced by using sentence-level term distances and pointwise mutual information can ...
متن کاملCrowdsourced Idea Generation: The Effect of Exposure to an Original Idea
The effect of exposure to an original or common idea on crowdsourced idea generation was studied by asking crowd workers to design a public service advertisement. As compared to having no idea exposure, exposure to an original idea decreased fluency and increased the average originality of ideas generated by each person. By contrast, exposure to a common idea had no effect on either idea origin...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Innovation-management Policy & Practice
سال: 2023
ISSN: ['1447-9338', '2204-0226']
DOI: https://doi.org/10.1080/14479338.2023.2215740